Research on Strategy of Load Balancing in Distributed ETL

doi:10.3969/j.issn.1006-2475.2011.09.054

Computer and Modernization ›› 2011, Vol. 193 ›› Issue (9): 201-204.doi: 10.3969/j.issn.1006-2475.2011.09.054

• 应用与开发 • Previous Articles Next Articles

Research on Strategy of Load Balancing in Distributed ETL

ZHANG Liang ¹, XIA Xiu-feng²

1.Vocational and Technical School of Shenyang Pharmaceutical University, Shenyang 110026, China;2.School of Computer Science and Engineering, Shenyang Aerospace University, Shenyang 110136, China

Received:2011-05-03 Revised:1900-01-01 Online:2011-09-22 Published:2011-09-22

Abstract

Abstract: After analyzing the importance of load balancing in distributed ETL, aiming at the limitation of traditional ETL used in distributed data warehouse, a new strategy that the data extracted from ETL node are divided according to the type of data is proposed, and then presents a new model of load balancing R-CN model that is combined by chain network model and Routers. On the basis of that presents a new load balancing strategy based on the data segment strategy and R-CN model. The strategy improves the ability of data processing greatly, and it also effectively increases the efficiency of distributed ETL.

Key words: distributed data warehouse, ETL, data partitioning, load balancing

CLC Number:

TP311

ZHANG Liang;XIA Xiu-feng. Research on Strategy of Load Balancing in Distributed ETL[J]. Computer and Modernization, 2011, 193(9): 201-204.

[1]	WANG Chong-yang, ZHUANG Yi. Load Balancing Algorithm of Multi-job Cluster Based on SDN and Improved CSA Algorithm [J]. Computer and Modernization, 2023, 0(11): 28-35.
[2]	FENG Zeng-xi, CHEN Hai-yue, WANG Tao, ZHAO Jin-tong, LI Shi-yan. Energy Consumption Prediction of Air-conditioning System in Underground Engineering Based on XGBoost Hyperparameter Optimization [J]. Computer and Modernization, 2023, 0(01): 108-113.
[3]	YUAN Jia-li, LIU Meng-chi. Dynamic Data Partition Algorithm for Information Network Model [J]. Computer and Modernization, 2022, 0(10): 100-105.
[4]	NI Ya-ting, YANG Wen-hui, MIAO Fang, HUANG An-qi, JIANG Yuan. Dynamic Load Balancing Strategy of DRC Cluster Based on Nginx [J]. Computer and Modernization, 2022, 0(04): 58-64.
[5]	DUAN Peng-fei, LAN Ru. Design of Network-level Moving Target Defense System Based on Blockchain [J]. Computer and Modernization, 2021, 0(08): 121-126.
[6]	LI Juan. Dynamic Load Balancing Algorithm for Heterogeneous Clusters Based on Internet of Things Technology#br# [J]. Computer and Modernization, 2021, 0(04): 104-108.
[7]	YAN Yi, ZHOU Kai-dong, LIN Xi-jun, MAI Xiao-hui, XIAO Jian-yi, ZENG Zhao-lin. Fault Location Algorithm for Electric Power Marketing System Based on Causal Rules [J]. Computer and Modernization, 2020, 0(03): 13-.
[8]	WEN Ting-ting, LI Hong-zhe. Elastic Load Balancing Algorithm for Cloud Computing Service [J]. Computer and Modernization, 2019, 0(10): 28-.
[9]	LI Yong-gang1, YUE Wen-tao1, LI Long-jiang2. A Load-balancing Algorithm in Overlapping System of TD-LTE and eHRPD [J]. Computer and Modernization, 2017, 0(5): 5-9.
[10]	LUAN Zhi-kun1, NIU Chao2. A Load-balanced Virtual Machine Scheduling Approach in Cloud Data Center [J]. Computer and Modernization, 2017, 0(5): 24-36.
[11]	ZHANG Nan, CHAI Xiao-li, XIE Bin, TANG Peng. Realization of Load Balancing Mechanism in Storm Streaming Processing Platform [J]. Computer and Modernization, 2017, 0(12): 65-70+76.
[12]	RAN Xun， YUAN Jianhua， LIU Yuguo， HU Yang. An Invoice Management System Based on Load Balancing [J]. Computer and Modernization, 2016, 0(10): 121-.
[13]	LUO Guizhang1，2，3. A Performance Optimization Schema for Huge Load Sakai System [J]. Computer and Modernization, 2015, 0(2): 101-.
[14]	FAN Xin1， HE Zhong-wei1， ZHANG Su-wei2. Research and Application of Data Warehouse Based on Pentaho [J]. Computer and Modernization, 2015, 0(11): 12-16+112.
[15]	LI Ou, CHEN Yan, LI Taoying. Implementation of Load Balancing Cluster Based on Linux [J]. Computer and Modernization, 2014, 0(9): 29-32.

Research on Strategy of Load Balancing in Distributed ETL

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments